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ABSTRACT 

The purpose of the study was to identify differences 
in cognitive skills associated with differing rates of predictive 
reasoning success for high school biology students, to determine 
possible correlations between predictive success and cognitive 
operational level, and to assess whether directed practice 
facilitated problem-solving success. The Group Test of Logical 
Thinking (GALT) was used to assess cognitive development, while 
written prediction sheets and oral interview were used to identify 
skill use patterns and measure predictive success. Treatment-group 
subjects then received 8 hours of directed practice in prediction 
using interactive computer simulations, and all subjects were 
retested. Predictive success showed a significant correlation both to 
subjects' operational level and to five specific cognitive skills. 
ANCOVA indicated a significant treatment effect, with marked 
increases in predictive success following practice in the identified 
problem-solving skills. (Author) 
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FACILITATING SUCCESSFUL PREDICTIVE REASONING IN BIOLOGY 
THROUGH APPLICATION OF SKILL THEORY 

Abstract 

The purpose of the study was to identify differences in cognitive 
skills associated with differing rates of predictive reasoning success for 
high school biology students, to determine possible correlations between 
predictive success and cognitive operational level, and to assess whether 
directed practice facilitated problem-solving success. The Group Test of 
Logical Thinking (GALT) was used to assess cognitive development, while 
written prediction sheets and oral interviews were used to identify skill 
use patterns and measure predictive success. Treatment-group subjects 
then received 8 hours of directed practice in prediction using interactive 
computer simulations, and all subjects were retested. Predictive success 
showed a significant correlation both to subjects' operational level and to 
five specific cognitive skills. ANCOVA indicated a significant treatment 
effect, with marked increases in predictive success following practice in 
the identified problem-solving skills. 

Introduction 

Facilitating students' development of analytical and logical 
thinking skills is a high priority in modern science education (Johnston & 
Aldridge, 1984; National Science Board, 1983). Teaching methods which 
effectively link procedural and declarative knowledge are necessary if 
students are to adequately develop the problem-solving skills required for 
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success in the science classroom and in society. Research into cognitive 
factors differentiating successful and unsuccessful problem-solvers has 
potential for suggesting teaching methods and classroom activities which 
promote the development of effective problem-solving skills (Aldridge, 
1992; Berkheimer, et a/., 1984; Linn, 1987; Rivers & Vockell, 1987). 

Predictive hypothesizing, or hypothetico-predictive reasoning, is 
a complex problem-solving skill comprised of such cognitive components 
as manipulation of variables, pattern identification, interpretation of 
feedback, evaluating alternative solutions, and rule inference (Butts, et 
al., 1978; Lavoie, 1993). Students in biological domains such as genetics 
and ecology are frequently asked to predict outcomes that depend upon the 
interactions of multiple variables within a dynamic system. Development 
of strong predictive reasoning skills is therefore fundamental to learning 
in these content areas, and research into cognitive behaviors associated 
with successful prediction has potential instructional benefits (Lavoie & 
Good, 1988; Sinclair & Good, 1991; Smith & Good, 1984). 

In order to develop and test teaching strategies which enhance 
students' predictive reasoning skills, factors affecting predictive success 
must be identified. Previous studies have reported a number of cognitive 
behaviors associated with differences in problem-solving success. Novice 
and expert problem-solvers in chess and physics, for example, differ in 
their initial representation of the problem space (Chi, Feltovich, & Glaser, 
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1981; Simon & Simon, 1980). Differences have also been observed related 
to the ability to employ imagery (Glover, et al., 1 990), short-term memory 
capacity (Roth, 1 990), the ability to relate existing knowledge to a new 
problem (Pizzini, et al., 1989), and the domain specificity of many skills 
(Burbules & Linn, 1988). 

Constructivist models from the fields of cognitive science and 
developmental psychology have demonstrated potential for guiding science 
education research into the mental factors associated with successful 
problem-solving (Anderson, 1992; Dijkstra, 1991; Larkin & Rainard, 1984; 
Saunders, 1992; Wheatley, 1991). Such models treat learning as an active 
process in which the learner progressively develops an efficient cognitive 
network linking declarative and procedural knowledge by monitoring and 
responding to feedback (Inhelder & Piaget, 1958; Larkin & Rainard, 1984; 
Lohman, 1989; Mayer, 1989; Newell, 1990; Sternberg, 1984). Acquisition 
of problem-solving skill is seen as a dynamic process of elaborating the 
nodes linking various knowledge bases. 

In this model, performance on a cognitive activity progresses 
from being awkward and ineffecient to being increasingly successful as 
strategies are tested, revised, and internalized through repeated exposure. 
Information-processing models such as ACT* (Anderson, 1982), and 
developmental models such as skill theory (Fischer, 1 980), propose that 
acquisition of problem-solving skill is domain specific and dependent upon 
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opportunity to practice and refine the behaviors in an environment which 
permits low-risk testing while providing feedback and support. Problem- 
solving success is the result of a serial transformation of initial "weak" 
strategies into increasingly effective ones (Anderson, 1987; Fischer & 
Kenny, 1986; Newell & Rosenbloom, 1981). 

Models such as ACT* and skill theory provide a basis for studying 
cognitive differences distinguishing successful and unsuccessful subjects 
on the task of predictive reasoning, as well as indicating possible learning 
environments capable of improving that particular skill. Previous studies 
have reported a number of cognitive tendencies associated with predictive 
success in biology, including a strong content knowledge base and formal 
operational reasoning (Lavoie, 1993; Lavoie & Good, 1988; Smith, 1990). 
This investigation sought to confirm and add to those findings, as well as 
examining whether predictive success was enhanced by practice activities 
stressing the most highly-correlated cognitive behaviors. 

The purpose of the study was to identify differences in cognitive 
strategies which distinguish successful and unsuccessful students when 
solving prediction problems in biology, and to determine whether practice 
in an appropriate context significantly improved predictive success rates. 
The study also investigated the strength of the previously reported link 
between predictive reasoning success and subjects' cognitive operational 
level. 
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Methods 

The study was conducted over a two-month period at a suburban 
Minnesota public high school. Thirty subjects were selected at random 
from a pool of 365 students enrolled in a lOth-grade biology course. Four 
of the initial selectees were unwilling to participate and were replaced 
by others randomly picked from the same subject pool. All subjects were 
taught by one of three teachers comprising a cooperative planning team, 
and during the previous quarter all had completed similar units of study in 
ecology and genetics. Sample demographics were representative of the 
school, primarily Caucasian and lower middle class. 

Subjects' cognitive operational level was assessed by means of 
the Group Test of Logical Thinking (GALT), a frequently used twelve-item 
test of formal reasoning (Roadrangka, Yeany, & Padilla, 1983). Following 
administration of the GALT, subjects were asked to generate soiutions to 
ten prediction problems from the biological areas of ecology and genetics. 
These problems required subjects to predict the effect of one variable on 
another, or to predict an outcome dependent on the interactions between a 
number of variables. Questions used were taken from various test banks 
and were evaluated for content and face validity by a panel of educators. 

Successfully solving the problems required the use of predictive 
reasoning skills, and subjects were asked to describe in writing the steps 
used to arrive at each decision, a variation on the "think aloud" technique. 
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Subsequent to scoring of problem solutions, subjects were classified as 
successful (75-100% correct), transitional (60-70%), marginal (35-55%), 
or unsuccessful (0-30% correct). In order to receive full credit, subjects 
needed to make a plausible prediction in conjunction with valid causal 
reasoning. Deductions were taken for improbable predictions, predictions 
which merely restated the problem, partially valid or invalid cause-effect 
reasoning, unsupported predictions, and invalid predictions supported by 
apparently valid reasoning. A similar scoring format has been employed in 
previous investigations (Lavoie, 1993; Lavoie & Good, 1988). 

The written self-reports of subjects' reasoning processes were 
analyzed to determine the frequency of correct application of seven skills 
previously reported as showing a correlation with high predictive success 
(Lavoie & Good, 1988). This analysis, the results of which are reported in 
the next section, indicated five of these cognitive behaviors were highly 
correlated across all success categories, and subsequent activities were 
centered around these skills. Verification of the observed patterns was 
obtained through taped interviews with a subset of the subjects, results 
of which largely coincided with those from the written self-reports. 

Subjects were randomly assigned to treatment or control groups 
(n=1 5). Treatment subjects participated in 8 hours of learning sessions 
focussing on the five skills previously identified as highly correlated with 
effective prediction. Sessions were scheduled twice weekly after school 
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hours, with transportation provided, and were conducted by the students' 
regular biology teacher. Practice activities were built around interactive 
computer simulations relevant to ecology and genetics, allowing repeated 
testing of strategies, immediate feedback, and the opportunity to discuss 
and interact with other students in assessing possible solutions. Subjects 
thus received a large number of predictive experiences in a short period of 
time, a benefit of computers noted by previous studies (Jungck, 1991; 
Rivers & Vockell, 1987). 

Practice sessions followed the learning cycle format, which is 
well documented as an effective instructional method (Karplus, 1977). 
Subjects were permitted to work singly or in pairs, and exchange of ideas 
was encouraged. Following the exploration phase, subjects continued to 
use the simulations in conjunction with question sheets, teacher guidance, 
and group discussions designed to focus their practice on the identified 
problem-solving skills. No attempt was made to teach specific content, 
although any student requests for clarifying information were answered. 

Upon completion of the practice sessions, all subjects were again 
tested and asked to explain their reasoning, using the same questions as 
on the pretest. Analysis of covariance was performed to assess treatment 
effects while controlling for initial differences in predictive reasoning 
ability. A Pearson test for a correlation between cognitive operational 
level and predictive success was also performed. 
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Resul ts 

On the pretest, 1 3% of subjects were classified as successful, 
with an additional 27% categorized as transitional. A majority of subjects 
were therefore unsuccessful or only occasionally successful. A significant 
correlation with these success categories was identified for five of the 
seven cognitive skills examined, with differentials in frequency of use 
exceeding 65% (Table 1). 

While subjects in all categories correctly identified relevant 
information in the problem a majority of the time, successful subjects 
were much more likely to identify and apply relevant declarative and/or 
procedural knowledge which they possessed. The difference is especially 
pronounced between the highest and lowest success groups. 

Table 1. - Frequency of application for selected problem-solving skills by subjects 
at different levels of predictive reasoning success. 

Performance on Predictive Reasoning Test 





High 






Low 




Suooess 


Transitional 


Marginal 


Suress 


Selected Problem-solving Skills 


(275%) 


(60-70%) 


(35-55%) 


(<25% 


Identify information in problem 


90% 


86% 


71% 


70% 


Access relevant information in memory 


95% 


75% 


58% 


30% 


Identify cause-effect relationships 


95% 


74% 


42% 


20% 


Systematic approach to problem 


100% 


82% 


63% 


28% 


Use "if-then" reasoning 


100% 


88% 


83% 


62% 


Consider alternative solutions 


95% 


70% 


51% 


15% 


Identify inconsistencies in logic 


75% 


54% 


23% 


8% 
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As is readily apparent in Table 1, relative success in predicting 
corresponded closely with subjects' ability to retrieve content knowledge 
from memory and their effectiveness in identifying cause-effect patterns. 
Significant correlations were also evident for the frequency with which a 
systematic problem-solving approach was used, alternative solutions 
were considered, and logical inconsistencies were identified. Correct use 
of these five skills by unsuccessful subjects was observed on fewer than 
30% of the problems, while successful predictors applied them correctly 
at least 75% of the time. 

A significant correlation was also observed between subjects' 
cognitive operational level and their predictive reasoning success, with a 
Pearson r = .654 at the .001 level of confidence. Successful predictors 
tended to have developed formal reasoning, with a mean GALT score of 10, 
while unsuccessful subjects were concrete thinkers, averaging 4 on the 
GALT. Subjects whose predictive success fell between these extremes 
also tended to be transitional in their operational development. Scores on 
the GALT indicated 45% of the sample were formal operational, and 1 5% 
were still functioning primarily at a concrete level. 

Analysis of covariance, using posttest scores as the dependent 
variable and pretest scores as a covariate, indicated a significant effect 
for directed practice in the form of increased predictive success (p<.001). 
After controlling for other factors, mean scores for the treatment group 
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were 30% higher than scores for subjects in the control group. Treatment 
group means (on a 20-point scale) increased from 8.7 on the pretest to 
12.4 on the posttest, while control group means remained static on these 
measures. Despite this significant increase in the treatment group mean, 
the standard deviation did not change, indicating gains were broad-based 
rather than being limited to a few individuals. 

A one-way ANOVA performed on the covariate (pretest scores) 
confirmed (p<.01) assumptions of independence and of randomization in 
group assignment. 

Table 2. ~ Summary of ANCOVA for treatment effect of directed practice in 
prediction, using pretest as the covariate and posttest as the dependent variable 



Source of 
Variation 


cH 


Sum of 
Squares 


F 


Proh 


Equality of 










Adj. Means 


1 


67.05 


16.88* 


<.001 


Zero Slopes 










Covariates 


1 


431.31 


108.61' 


<.001 


Error 


27 


107.22 






Equality of Slopes 










Covariates, 










Groups 


1 


.53 


.13' 


.723 


Error 


26 


106.69 







crit. (.01, 1, 27) = 7 - 68 ; F ait. (.05, 1, 26) = 4 - 22 
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Conclusions 

The results of this study indicate that successful prediction is 
dependent upon interactions among several factors, including a subject's 
procedural and declarative knowledge, stage of cognitive development, and 
prior experience in applying predictive reasoning. The skill-use patterns 
identified as showing a significant correlation with effective prediction 
are consistent with general problem-solving tendencies noted in previous 
studies (Horak, 1991; Lavoie & Good, 1988; Smith, 1990). This research 
confirms those general findings, and quantifies the correlation for several 
specific behaviors. 

Successful subjects were more likely to employ a systematic 
problem-solving approach, to evaluate a number of alternative solutions, 
and to review their answer for logical inconsistencies. They also were 
more likely to identify and apply cause-effect relationships and other 
declarative knowledge that was correct and relevant to the problem. 

Unsuccessful subjects were nearly as effective in extracting 
information from a problem, but they were much less likely to identify 
correct cause-effect relationships or to retrieve relevant knowledge from 
memory. Even when they appeared to possess relevant content knowledge, 
they tended to apply it incorrectly, and seemed to have a greater number 
of misconceptions about the topic. Unsuccessful subjects also tended to 
attack a problem haphazardly, seldom evaluated more than one possible 
solution, and rarely reviewed their answers for inconsistencies in logic. 
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It is unclear from these results whether declarative knowledge or 
procedural skills are the primary limiting factor for predictive success, 
and it seems likely that effective prediction depends upon a network of 
interactions between these two knowledge bases. In addition, a strong 
correlation was found linking successful prediction and formal reasoning, 
and the relative importance of cognitive development versus procedural 
and content knowledge is a further uncertainty. 

While a previous study indicated initial content knowledge might 
be the more critical determinant of predictive success, it also provided 
evidence of the strong influence exerted by cognitive operational level 
(Lavoie & Good, 1988). In the present study, it is worth noting that while 
post-treatment gains in predictive success were substantial for subjects 
who were formal operational or transitional, those who were concrete 
operational made much smaller improvements. The ability to consider the 
possible instead of the actual is one of the hallmarks of formal thought, 
and concrete thinkers may find it difficult to predict effectively, even if 
they have other requisite knowledge and skills. 

In its simplest form, prediction is a process of combining initial 
knowledge with cau. e-effect rules to arrive at a hypothetical outcome 
(Carlson, et al., 1 989). Results of this study indicate successful subjects 
need to know certain concepts, be able to recognize their relevance to the 
problem, and know how to apply them toward producing a solution. They 
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must possess the appropriate procedural and declarative knowledge, and 
must have established effective connections between the two. Significant 
correlations with predictive success were noted for behaviors in both 
knowledge domains, and it appears that deficiencies in one area affect the 
other negatively as well. 

This conclusion is consistent with skill theory and many other 
constructivist models, which propose that declarative and procedural 
knowledge develop together, not independently. Problem solving takes 
place within the context of prior knowledge, and both types are essential 
to problem-solving success (Anderson, 1987; Cohen, 1983; Fischer, 1980). 
Since successful prediction problem-solving is correlated to both content 
and process skills, it would seem that science education ought to provide 
support for their simultaneous development in a context that will promote 
useful connections between them. 

Although content instruction during directed practice sessions 
was incidental and minor, subjects were continually applying their prior 
knowledge to arrive at problem solutions. The emphasis was on procedural 
skills, but these had to be linked with declarative knowledge in order to 
predict plausible outcomes. Post-treatment improvement in prediction 
success indicates more effective problem-solving skills may be developed 
through experiences which improve recognition, retrieval, and application 
of existing knowledge. 

* 
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Such a result is consistent with current models of cognition, 
which assume that successful problem-solvers are those who have had the 
opportunity to test and refine their procedures in specific domains. By 
repeatedly testing and revising generalized, weak cognitive strategies on 
problems in a particular domain, subjects progressively develop them into 
more effective methods with a higher frequency of success (Andre, 1 986; 
Fischer & Pipp, 1984; Lesgold, 1988; Neves & Anderson, 1981). This study 
found evidence of improved problem-solving skill after directed practice, 
although it did not establish whether the improved prediction skills were 
transferable to other content domains. 

Within its limits, this investigation showed problem-solving 
effectiveness for most subjects could be improved by a relatively small 
amount of practice. Cumulative practice time was less than ten hours, yet 
subjects in all success categories achieved significant improvement in 
predictive success. More practice might result in more improvement, but 
it appears benefits may be realized from fairly modest practice durations. 
Using computer simulations to focus on a few specific skills permitted 
subjects to test alternative strategies and receive immediate feedback on 
their relative effectiveness, and provided numerous trials and reinforcing 
opportunities during each practice session. 

Although previous studies of prediction problem-solving have not 
directly investigated the effects of practice on success rates, one study 
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noted that subjects made progressively fewer unsuccessful predictions 
during a series of problem-solving sessions, suggesting a practice effect 
did occur (Lavoie & Good, 1988). Such a finding is consistent with the 
results of this investigation, which indicates that directed practice leads 
to improved predictive reasoning success. While content knowledge and 
cognitive development are factors limiting procedural effectiveness, it 
seems clear that development of viable problem-solving skills is enhanced 
by practice and experience. 
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